The purpose of the report is to aggregate and examine selected techniques of imputation of missing data in the context of their impact on the prediction efficiency of classification algorithms. The following considerations include various imputation techniques, both basic (median / mode imputation) and more sophisticated (selected methods from the mice, VIM, missRanger and softImpute packages).
For testing purposes, as the classification algorithm, we used the ranger algorithm, which is a fast implementation of random forest, particularly suited for high dimensional data. The prediction effectiveness was assessed in relation to the AUC, balanced accuracy and Matthews correlation coefficient measures.

The report contains, all the results, grouped by both: package and dataset.

basic (median/mode)

adult

Crossvalidation results

Imputation times

## Imputation time:  0.101

Test set results

## Test set AUC:  0.916
## Test set BACC:  0.78
## Test set MCC:  0.602

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  0.008

Test set results

## Test set AUC:  0.955
## Test set BACC:  0.888
## Test set MCC:  0.784

Missings overview

dresses-sales

Crossvalidation results

Imputation times

## Imputation time:  0.009

Test set results

## Test set AUC:  0.56
## Test set BACC:  0.516
## Test set MCC:  0.036

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  0.012

Test set results

## Test set AUC:  0.894
## Test set BACC:  0.838
## Test set MCC:  0.677

Missings overview

credit-approval

Crossvalidation results

Imputation times

## Imputation time:  0.009

Test set results

## Test set AUC:  0.931
## Test set BACC:  0.876
## Test set MCC:  0.753

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.007

Test set results

## Test set AUC:  0.963
## Test set BACC:  0.833
## Test set MCC:  0.679

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  0.04

Test set results

## Test set AUC:  0.996
## Test set BACC:  0.927
## Test set MCC:  0.898

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  0.349

Test set results

## Test set AUC:  1
## Test set BACC:  0.986
## Test set MCC:  0.983

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  0.01

Test set results

## Test set AUC:  0.88
## Test set BACC:  0.713
## Test set MCC:  0.426

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  0.012

Test set results

## Test set AUC:  0.996
## Test set BACC:  0.976
## Test set MCC:  0.953

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  0.016

Test set results

## Test set AUC:  0.933
## Test set BACC:  0.864
## Test set MCC:  0.774

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.006

Test set results

## Test set AUC:  0.74
## Test set BACC:  0.654
## Test set MCC:  0.316

Missings overview

missRanger

adult

Crossvalidation results

Imputation times

## Imputation time:  31.747

Test set results

## Test set AUC:  0.917
## Test set BACC:  0.78
## Test set MCC:  0.605

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  2.171

Test set results

## Test set AUC:  0.959
## Test set BACC:  0.896
## Test set MCC:  0.796

Missings overview

dresses-sales

Crossvalidation results

Imputation times

## Imputation time:  1.714

Test set results

## Test set AUC:  0.547
## Test set BACC:  0.508
## Test set MCC:  0.018

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  2.319

Test set results

## Test set AUC:  0.922
## Test set BACC:  0.865
## Test set MCC:  0.698

Missings overview

credit-approval

Crossvalidation results

Imputation times

## Imputation time:  1.718

Test set results

## Test set AUC:  0.918
## Test set BACC:  0.824
## Test set MCC:  0.644

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.614

Test set results

## Test set AUC:  0.944
## Test set BACC:  0.875
## Test set MCC:  0.75

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  9.945

Test set results

## Test set AUC:  0.997
## Test set BACC:  0.917
## Test set MCC:  0.886

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  445.443

Test set results

## Test set AUC:  1
## Test set BACC:  0.98
## Test set MCC:  0.976

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  0.99

Test set results

## Test set AUC:  0.87
## Test set BACC:  0.713
## Test set MCC:  0.426

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  1.664

Test set results

## Test set AUC:  0.997
## Test set BACC:  0.976
## Test set MCC:  0.953

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  5.739

Test set results

## Test set AUC:  0.942
## Test set BACC:  0.864
## Test set MCC:  0.774

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.665

Test set results

## Test set AUC:  0.757
## Test set BACC:  0.731
## Test set MCC:  0.5

Missings overview

VIM (knn)

adult

Crossvalidation results

Imputation times

## Imputation time:  95.577

Test set results

## Test set AUC:  0.916
## Test set BACC:  0.778
## Test set MCC:  0.601

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  0.407

Test set results

## Test set AUC:  0.962
## Test set BACC:  0.895
## Test set MCC:  0.797

Missings overview

dresses-sales

Crossvalidation results

Imputation times

## Imputation time:  0.578

Test set results

## Test set AUC:  0.582
## Test set BACC:  0.535
## Test set MCC:  0.076

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  0.886

Test set results

## Test set AUC:  0.935
## Test set BACC:  0.893
## Test set MCC:  0.777

Missings overview

credit-approval

Crossvalidation results

Imputation times

## Imputation time:  0.147

Test set results

## Test set AUC:  0.919
## Test set BACC:  0.843
## Test set MCC:  0.687

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.093

Test set results

## Test set AUC:  0.944
## Test set BACC:  0.875
## Test set MCC:  0.75

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  5.749

Test set results

## Test set AUC:  0.996
## Test set BACC:  0.927
## Test set MCC:  0.898

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  239.473

Test set results

## Test set AUC:  1
## Test set BACC:  0.98
## Test set MCC:  0.976

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  0.207

Test set results

## Test set AUC:  0.917
## Test set BACC:  0.713
## Test set MCC:  0.426

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  0.365

Test set results

## Test set AUC:  0.997
## Test set BACC:  0.976
## Test set MCC:  0.953

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  1.165

Test set results

## Test set AUC:  0.942
## Test set BACC:  0.876
## Test set MCC:  0.793

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.102

Test set results

## Test set AUC:  0.74
## Test set BACC:  0.692
## Test set MCC:  0.404

Missings overview

VIM (hotdeck)

adult

Crossvalidation results

Imputation times

## Imputation time:  0.122

Test set results

## Test set AUC:  0.916
## Test set BACC:  0.779
## Test set MCC:  0.602

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  0.071

Test set results

## Test set AUC:  0.963
## Test set BACC:  0.895
## Test set MCC:  0.797

Missings overview

dresses-sales

Crossvalidation results

Imputation times

## Imputation time:  0.07

Test set results

## Test set AUC:  0.622
## Test set BACC:  0.588
## Test set MCC:  0.2

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  0.11

Test set results

## Test set AUC:  0.946
## Test set BACC:  0.816
## Test set MCC:  0.64

Missings overview

credit-approval

Crossvalidation results

Imputation times

## Imputation time:  0.051

Test set results

## Test set AUC:  0.943
## Test set BACC:  0.896
## Test set MCC:  0.786

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.041

Test set results

## Test set AUC:  0.963
## Test set BACC:  0.917
## Test set MCC:  0.826

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  0.091

Test set results

## Test set AUC:  0.996
## Test set BACC:  0.907
## Test set MCC:  0.874

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  0.749

Test set results

## Test set AUC:  1
## Test set BACC:  0.984
## Test set MCC:  0.98

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  0.067

Test set results

## Test set AUC:  0.861
## Test set BACC:  0.713
## Test set MCC:  0.426

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  0.072

Test set results

## Test set AUC:  0.996
## Test set BACC:  0.962
## Test set MCC:  0.929

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  0.127

Test set results

## Test set AUC:  0.933
## Test set BACC:  0.857
## Test set MCC:  0.752

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.037

Test set results

## Test set AUC:  0.751
## Test set BACC:  0.731
## Test set MCC:  0.463

Missings overview

softImpute

adult

Crossvalidation results

Imputation times

## Imputation time:  0.097

Test set results

## Test set AUC:  0.916
## Test set BACC:  0.78
## Test set MCC:  0.602

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  0.012

Test set results

## Test set AUC:  0.933
## Test set BACC:  0.859
## Test set MCC:  0.716

Missings overview

dresses-sales

Crossvalidation results

Imputation times

## Imputation time:  0.015

Test set results

## Test set AUC:  0.551
## Test set BACC:  0.535
## Test set MCC:  0.076

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  0.08

Test set results

## Test set AUC:  0.898
## Test set BACC:  0.819
## Test set MCC:  0.623

Missings overview

credit-approval

Crossvalidation results

Imputation times

## Imputation time:  0.016

Test set results

## Test set AUC:  0.931
## Test set BACC:  0.868
## Test set MCC:  0.739

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.012

Test set results

## Test set AUC:  0.972
## Test set BACC:  0.833
## Test set MCC:  0.679

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  0.097

Test set results

## Test set AUC:  0.997
## Test set BACC:  0.917
## Test set MCC:  0.886

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  1.002

Test set results

## Test set AUC:  1
## Test set BACC:  0.978
## Test set MCC:  0.974

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  0.101

Test set results

## Test set AUC:  0.843
## Test set BACC:  0.731
## Test set MCC:  0.525

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  0.016

Test set results

## Test set AUC:  0.996
## Test set BACC:  0.976
## Test set MCC:  0.953

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  0.032

Test set results

## Test set AUC:  0.94
## Test set BACC:  0.876
## Test set MCC:  0.793

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.034

Test set results

## Test set AUC:  0.74
## Test set BACC:  0.692
## Test set MCC:  0.404

Missings overview